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AUTOMATED SPEECH RECOGNITION FILTER 



5 

BACKGROUND OF THE INVENTION 



1. FIELD OF THE INVENTION 

The present invention generally relates to automated speech recognition 
10 ("ASR") methods and systems. The present invention particularly relates to ASR 
methods and devices for providing an input speech signal to an ASR platform 
that approximates an original speech signal. 



2. DESCRIPTION OF THE RELATED ART 

15 An ASR platform as known in the art is designed to respond to a reception 

of a transmitted speech signal (e.g., voice commands) from a transceiver (e.g., 
mobile phones, embedded car phones, and phone enabled personal data 
assistants) with an audio signal that corresponds to the context of the transmitted 
speech signal. However, the performance of prior art ASR platform is adversely 

20 affected by any signal degradation of the transmitted speech signal (e.g., 

acoustical coupling and signal distortion) along a transmission signal path from a 
user of the transceiver to the ASR platform. Prior art attempts to minimize, if not 
eliminate, any signal degradation of the transmitted speech signal have generally 
proven to be unacceptable. The present invention addresses this problem. 

25 
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SUMMARY OF THE INVENTION 

The present invention relates to an automated speech recognition filter 
that overcomes the aforementioned disadvantages of the prior art. Various 
5 aspects of the invention are novel, non-obvious, and provide various advantages. 
While the actual nature of the present invention covered herein can only be 
determined with reference to the claims appended hereto, certain features, which 
are characteristic of the embodiments disclosed herein, are described briefly as 
follows. 

10 One form of the present invention is an automated speech recognition 

filter including means for determining one or more models representative of a 
signal degradation of a first speech signal transmitted from a transceiver to the 
automated speech recognition filter, and means for providing a second speech 
signal as a function of the model(s) whereby the second speech signal is an 

1 5 approximation of the first speech signal. 

A second form of the invention is an automated speech recognition 
filtering device comprising means for determining one or more models 
representative of a signal degradation of a first speech signal transmitted from a 
transceiver to said automated speech recognition filtering device, and means for 

20 providing a second speech signal as a function of the model(s) whereby the 
second speech signal is an approximation of the first speech signal. The 
automated speech recognition filtering device further comprises a database 
operable to store a user profile corresponding to the first set of one or more 
models. 

25 A third form of the invention is an automated speech recognition system 

comprising means for determining one or more models representative of a signal 
degradation of a first speech signal transmitted from a transceiver to the 
automated speech recognition system, and means for providing a second speech 
signal as a function of the model(s) whereby the second speech signal is an 

30 
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approximation of the first speech signal. The automated speech recognition 
system further comprises an automated speech recognition platform operable to 
provide an audio signal in response to a reception of the second speech signal 
5 with the audio signal corresponding to a context of the first speech signal. 

The foregoing forms, and other forms, features and advantages of the 
invention will become further apparent from the following detailed description of 
the presently preferred embodiments, read in conjunction with the accompanying 
drawings. The detailed description and drawings are merely illustrative of the 
10 invention rather than limiting, the scope of the invention being defined by the 
appended claims and equivalents thereof. 

BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 is an illustration of a hands-free, in-vehicle environment in 
15 accordance with the present invention; 

FIG. 2 is an illustration of a transmission signal path and a reception signal 
path between a vehicle and a wireline network as known in the art; 

FIG. 3 is a block diagram of a first embodiment of an automated speech 
recognition filtering device in accordance with the present invention; and 
20 FIG. 4 is a block diagram of a second embodiment of an automated 

speech recognition filtering device in accordance with the present invention. 
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DETAILED DESCRIPTION OF THE 
PRESENTLY PREFERRED EMBODIMENTS 

FIG. 1 illustrates a hands-free, in-vehicle environment containing a 

5 conventional vehicle 10, a conventional wireless network 30, a conventional 

wireline network 40, an ASR filtering device 50 of the present invention, and a 

conventional ASR platform 60. A user 1 1 of a transceiver in the form of a mobile 

phone 20 is seated within vehicle 10. In other embodiments of the present 

invention, the transceiver can be in the form of an embedded car phone, a phone 

10 enabled personal data assistant, and any other transceiver for transmitting and 
receiving a phone call. 

A more detailed explanation of the invention will now be provided herein. 
Those having ordinary skill in the art will appreciate that the various described 
signals are based upon a discrete time instant k and the various described filters 

1 5 and models are based upon a discrete time, frequency domain operator z. 
Specifically, the operator z is used to represent the frequency response 
characteristics of the filters and the models described herein. Additionally, those 
having ordinary skill in the art will appreciate that an audio signal of the present 
invention can include one or more forms of sound. 

20 Mobile phone 20 conventionally transmits a transmission signal Ti[k] to 

wireless network 30 in response to user 1 1 articulating a speech signal Ui[k] in a 
direction of a microphone (not shown) of mobile phone 20. Speech signal Ui[k] 
is a main component of transmission signal Ti[k]. A noise signal Ni[k] consisting 
of noise emanating from various sources of vehicle 10 (e.g., an engine, a 

25 heater/air conditioner, a radio, and a pair of wiper blades) are also components 
of transmission signal Ti[k]. In addition, an audio signal Rs[k] (FIG. 2) being an 
acoustically coupled form of an audio signal R^k] is a component of transmission 
signal Ti[k]. Transmission signal Ti[k] therefore ranges from a slightly distorted 
version of speech signal Ui[k] to a significantly distorted version of speech signal 

30 
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Ui[k] as a function of an intensity of the vehicle noise signal Ni[k] and an intensity 
of audio signal Rs[k] generated by mobile phone 20, wireless network 30, and 
wireline network 40. 

5 Wireless network 30 (e.g., an advanced mobile phone service, a time 

division multiple access network, a code division multiple access network, and a 
global system for mobile communications) conventionally transmits a 
transmission signal T2[k] to wireline network 40 in response to a reception of 
transmission signal Ti[k] by wireless network 30. The conventional transmission 

1 0 of transmission signal T2[k] involves a degree of signal distortion and a degree of 
signal attenuation of transmission signal Ti[k] by wireless network 30. 
Transmission signal T2[k] therefore ranges from a slightly distorted version of 
transmission signal Ti[k] to a significantly distorted version of transmission signal 
Ti[k] as a function of an intensity of the signal distortion and an intensity of the 

1 5 signal attenuation by wireless network 30 upon transmission signal Ti[k]. 

Wireline network 40 (e.g., a Public Switched Telephone Network, and 
VOIP network) conventionally transmits a transmission signal T3[k] to ASR 
filtering device 50 in response to a reception of transmission signal T2M by 
wireline network 40. The conventional transmission of transmission signal T 3 [k] 

20 involves a degree of signal distortion and a degree of signal attenuation of 
transmission signal T2[k] by wireline network 40. Transmission signal T3[k] 
therefore ranges from a slightly distorted version of transmission signal T2[k] to a 
significantly distorted version of transmission signal T2[k] as a function of an 
intensity of the signal distortion and an intensity of the signal attenuation by 

25 wireline network 40 upon transmission signal T 2 [k]. 
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ASR filtering device 50 uniquely transmits a speech signal U2M to ASR 
platform 60 (e.g., a computer platform employing commercially available speech 
recognition software from Nuance of Menlo Park, California or SpeechWorks of 
5 Boston, Massachusetts) in response to a reception of transmission signal T3[k] 
by ASR filtering device 50. The unique transmission of speech signal U2M by 
ASR filtering device 50 involves a utilization of profile based characteristics of 
vehicle 10, mobile phone 20, wireless network 30, and wireline network 40 as 
well as a utilization of real-time signal characteristics of transmission signal T3[k], 

10 audio signal Ri[k], and an estimate of vehicle noise signal N[k]. The result, as 
will be further described herein in connection with FIGS. 3 and 4, ASR filtering 
device 50 transmits speech signal U2[k] to ASR platform 60 as an approximation 
of speech signal Ui[k]. An improved performance of ASR platform 60 is 
therefore facilitated by a reception of speech signal U2[k] by ASR platform 60. 

15 FIG. 2 illustrates a transmission signal path from vehicle 10 to wireline 

network 40 and a reception signal path from wireline network 40 to vehicle 10. In 
vehicle 10, a speech signal lb[k], a vehicle noise signal N2[k], and audio signal 
R 5 [k] serve as inputs of a summation process for generating a speech signal 
U4[k] that is a degraded version of speech signal Ui[k]. A processing function in 

20 the form of an acoustic model 12 represents an acoustical effect on speech 
signal Ui[k] that produces speech signal U3M as a result of a distance between 
user 1 1 (FIG. 1 ) and a microphone (not shown) of mobile phone 20. A 
processing function in the form of an acoustic model 13 represents an acoustical 
effect on vehicle noise signal Ni[k] by vehicle 10 that produces vehicle noise 

25 signal N 2 [k]. A processing function in the form of an acoustic model 14 

represents an acoustical effect on audio signal R^k] that produces audio signal 
Rs[k] resulting from an acoustical coupling between the microphone and a 
speaker (not shown) of mobile phone 20. Variable n within acoustic models 12- 
14 corresponds to a particular type of vehicle 10 (FIG. 1). 
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The transmission signal path includes processing functions in the form of 
a transmission model 21 of mobile phone 20, a transmission model 31 of 
wireless network 30, and a transmission model 41 of wireline network 40. The 

5 reception signal path includes processing functions in the form of a reception 
model 22 of mobile phone 20, a reception model 32 of wireless network 30, and 
a reception model 42 of wireline network 40. 

Transmission model 21 represents a signal degradation of speech signal 
Ui[k] by mobile phone 20 in a generation of transmission signal Ti[k] by mobile 

1 0 phone 20 in response to a reception of speech signal 114k] during a transmission 
mode of operation of mobile phone 20. Reception model 22 represents a signal 
degradation of audio signal Ri[k] by mobile phone 20 in a generation audio signal 
R4k] by mobile phone 20 in response to a reception of audio signal R3[k] during a 
reception mode of operation of mobile phone 20. Variable m within transmission 

15 model 21 and reception model 22 corresponds to a particular type of mobile 
phone 20. 

Transmission model 31 represents a signal degradation of speech signal 
Ui[k] by wireless network 30 in a generation of transmission signal T 2 [k] by 
wireless network 30 in response to a reception of transmission signal Ti[k] during 

20 a transmission mode of operation of wireless network 30. Reception model 32 
represents a signal degradation of audio signal Ri[k] by wireless network 30 in a 
generation of audio signal R3[k] by wireless network 30 in response to a 
reception of audio signal R2[k] during a reception mode of operation of wireless 
network 30. Variable within transmission model 31 and reception model 32 

25 corresponds to a particular type of wireless network 30. 
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Transmission model 41 represents a signal degradation of speech signal 
Ui[k] by wireline network 40 in a generation of transmission signal T3[k] by 
wireline network 40 in response to a reception of transmission signal T2[k] during 
5 a transmission mode of operation of wireline network 40. Reception model 42 
represents a signal degradation of audio signal Ri[k] by wireline network 40 in a 
generation of audio signal R2[k] by wireline network 40 in response to a reception 
of audio signal Ri[k] during a reception mode of operation of wireline network 40. 
Variable / within transmission model 41 and reception model 42 corresponds to 

1 0 a particular type of wireline network 40. 

FIG. 3 illustrates ASR filtering device 150 as one embodiment of ASR 
filtering device 50 (FIG. 1). ASR filtering device 150 includes a noise 
suppression module 151 and an ASR filter 152 which both may be comprised of 
digital circuitry, analog circuitry, or both (e.g., an application specific integration 

15 circuit). Also, noise suppression module 151 and ASR filter 152 may be 
programmable, dedicated state machines, or a hybrid combination of 
programmable and dedicated hardware. To implement the principals of the 
present invention, ASR filtering device 150 can further include any control clocks, 
interfaces, signal conditioners, filters, Analog-to-Digital (A/D) converters, Digital- 

20 to-Analog (D/A) converters, communication ports, or other types of operators as 
would occur to those having ordinary skill in the art. 

In one embodiment, ASR filtering device 150 includes one or more 
commercially available microprocessors (not shown) operatively coupled to one 
or more commercially available solid-state memory devices (not shown) 

25 containing programming corresponding to noise discrimination module 151 and 
ASR filter 152 as software modules. In the illustrated embodiment, ASR filtering 
device 150 further includes a database 153 containing user profiles including 
known and/or unknown values of variables n, m.y'and /'illustrated in FIG. 2. The 
following TABLE 1 is an exemplary listing of user profiles within database 153: 

30 
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TABLE 1 



USER 


VARIALBE 


VARIABLE 


VARIABLE 


VARIABLE 


PROFILE 


n 


m 


j 


/ 


1 


1 (Car X) 


1 (Phone X) 


1 (AMPS) 


1 (PSTN) 


2 


1 (Car X) 


2 (PDA X) 


2 (TDMA) 


1 (PSTN) 


3 


2 (Car Y) 


3 (ECP X) 


3 (CDMA) 


2 (VoIP) 


4 


2 (Car Y) 


1 (Phone X) 


Unknown 


Unknown 


5 


3 (Car Z) 


2 (PDA X) 


Unknown 


Unknown 


6 


3 (Car Z) 


3 (ECP X) 


Unknown 


Unknown 



In TABLE 1, PDA is an abbreviation for phone enabled personal data 
5 assistant and ECP is an abbreviation for an embedded car phone. 

The operation of ASR filter device 1 50 will now be described herein. First, 
noise suppression module 151 conventionally provides a transmission signal 
T 4 [k] to ASR filter 152 in response to a reception of transmission signal T 3 [k] from 
wireline network 40 (FIG. 1) by ASR filtering device 150. In one embodiment, 
10 noise suppression module 151 conventionally attenuates vehicle noise N2[k] from 
transmission signal T3[k] in generating transmission signal Ti[k]. 

Second, ASR filter 152 receives transmission signal T4k] and audio signal 
Ri[k] to provide a speech signal U2[k] as an approximation of speech signal Ui[k]. 
In one embodiment, ASR filter 152 identifies a user profile in response to an 
1 5 identification signal (not shown) to ASR platform 60 via ASR filtering device 1 50 
prior to the reception of transmission signal T3[k] by ASR filtering device 150, and 
thereafter reads the values of variables n, m, j and /' from the identified user 
profile as stored in database 153. The identification signal can include a data 
component or a characteristic indicating a frequency response characteristic of 
20 mobile phone 20 or wireless network 30 as would occur to those having ordinary 
skill in the art. 
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In response to variables n, mj and /', ASR filter 152 establishes a filter 
Jti(z,iJ,m,n)[k] in accordance with the following equations [1]-[3]: 

5 p i1 =c:*w/*f; [1] 

P rx = a; * c; * wj * f; [2] 

J.,(z,i,j,m,n)[k\ = [3] 

ASR filter 152 filters transmission signal T 4 [k] and audio signal Ri[k] 
10 through filter Jti(z,/V,m,n)[k] to provide speech signal U2M as an approximation of 
speech signal Ui[k]. 

In embodiments of the present invention wherein wireless network 30 is 
omitted, ASR filter 152 establishes a filter J t 2{z,i,m,n)[k] in accordance with the 
following equations [4]-[6]: 
15 Pn=C;*F; [4] 

p r2 = a: * c; n * f; [5] 

J l2 (z,i,m,n)[k] = IbJ 

' 2 p l2 *A;;*T A [k] 

whereby ASR filter 152 filters transmission signal T 4 [k] and audio signal 
20 Ri[k] through filter Jt2(z,/,m > r>)[k] to provide speech signal U 2 [k] as an 
approximation of speech signal Ui[k]. 
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In embodiments of the present invention wherein wireline network 40 is 
omitted, ASR filter 152 establishes a filter J t 3{zJ,m,n)[k] in accordance with the 
following equations [7]-[9]: 

5 

p» = c; * iv/ [7] 

P r3 = A" r * C r " * W/ [8] 

j a M.*.»m- T ' lk] - lPa ' p '>' R,m Pi 

whereby ASR filter 152 filters transmission signal T 4 [k] and audio signal 
1 0 Ri [k] through filter Jt3(zj',m,n)[k] to provide speech signal U2[k] as an 
approximation of speech signal Ui[k]. 

In embodiments of the present invention wherein wireless network 30 and 
wireline network 40 is omitted, ASR filter 152 establishes a filter J M (z,m,n)[k] in 
accordance with the following equations [10]-[12]: 



15 



P I4 =C? [10] 

p r4 =A';*c; [11] 

J,Az,m,n)[k] = [12] 

P l4 *A;*T 4 [k] 1 J 



20 whereby ASR filter 1 52 filters transmission signal T 4 [k] and audio signal 

Ri[k] through filter J t 4(z,m,n)[k] to provide speech signal U2M as an 
approximation of speech signal Ui[k]. 
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FIG. 4 illustrates ASR filtering device 250 as one embodiment of ASR 
filtering device 50 (FIG. 1). ASR filtering device 250 includes a noise 
discrimination module 251 and an ASR filter 252 which both may be comprised 
5 of digital circuitry, analog circuitry, or both (e.g., an application specific integration 
circuit). Also, noise discrimination module 251 and ASR filter 252 may be 
programmable, dedicated state machines, or a hybrid combination of 
programmable and dedicated hardware. To implement the principals of the 
present invention, ASR filtering device 250 can further include any control clocks, 

10 interfaces, signal conditioners, filters, Analog-to-Digital (AID) converters, Digital- 
to-Analog (D/A) converters, communication ports, or other types of operators as 
would occur to those having ordinary skill in the art. 

In one embodiment, ASR filtering device 250 includes one or more 
commercially available microprocessors (not shown) operatively coupled to one 

15 or more commercially available solid-state memory devices (not shown) 

containing programming corresponding to noise discrimination module 251 and 
ASR filter 252. In the illustrated embodiment, ASR filtering device 250 further 
includes a database 253 containing user profiles including known and/or 
unknown values of variables n, m, j and /' similarly to the description of database 

20 153 (FIG. 3). 

The operation of ASR filter device 250 will now be described herein. First, 
noise discrimination module 251 provides a noise discrimination signal y[k] to 
ASR filter 252 in response to a reception of transmission signal T3[k] from 
wireline network 40 (FIG. 1 ) by ASR filtering device 250. In one embodiment, 
25 noise discrimination module 251 inputs transmission signal Tj[k] to compute 

noise discrimination signal y[k] in accordance with the following equations [1] and 
[13]: 

P n = C"' * W/ * Ff [1] 
y[k] = P,*A" 0 *N,[k a ] [13] 

30 
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where k n is a time sample during which speech signal lh[k] (FIG. 2) is not 
present within transmission signal T 3 [k] and vehicle noise signal Ni[k] (FIG. 2) is 
within transmission signal T3[k]. Noise discrimination module 251 determines an 
5 absence of speech signal Ui[k] and a presence of vehicle noise signal Ni[k] 
within transmission signal T3[k] by distinguishing a significant difference in 
different energy level ranges and spectral characteristics of transmission signal 
T 3 [k]. Noise discrimination module 251 assumes a steady state noise 
characteristics of vehicle noise signal Ni[k] to thereby generate noise 
10 discrimination signal y[k] in accordance with the following equation [14]: 



y[k]zP l} *A a 0 *N x [k] [14] 

Second, ASR filter 252 receives transmission signal T 3 [k], noise 
discrimination signal y[k], and audio signal Ri[k] to provide speech signal U2[k] as 

15 an approximation of speech signal Ui[k]. In one embodiment, ASR filter 252 
identifies a user profile in response to an identification signal (not shown) 
transmitted to ASR platform 60 via ASR filtering device 250 prior to the reception 
of transmission signal T 3 [k] by ASR filtering device 250, and thereafter reads the 
values of variables n, m, j and / from the identified user profile as stored in 

20 database 253. The identification signal can include a data component or a 

characteristic indicating a frequency response characteristic of mobile phone 20 
or wireless network 30 as would occur to those having ordinary skill in the art. 
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In response to variables n, m, j and /', ASR filter 252 establishes a filter 
Jts{z,iJ,m,n)[k] in accordance with the following equations [1], [2], [14] and [15]: 



P n = C," * W/ * f; 



P = A" * C" *W'* F' 



J lS (z,i,j,m,n)[k] = 



P lt *A" a *(T 3 [k]-y[kJ) 



[1] 
[2] 
[14] 

[15] 



10 ASR filter 252 filters transmission signal T3[k], noise discrimination signal 

y[k], and audio signal Ri[k] through filter Ji5(z,iJ,m,n)[k] to provide speech signal 
U2[k] as an approximation of speech signal Ui[k]. 

In embodiments of the present invention wherein wireless network 30 is 
omitted, ASR filter 252 establishes a filter J t 6(z,i,m,n)[k] in accordance with the 

15 following equations [4], [5], [16] and [17]: 



p _ c m * F' 
r i2 - *-t r i 



p r2 = A" r *c? *f; 



20 



y[k] = P l2 *A n 0 *N,[k] 

T i [k}-y[k]-{P ll *Pn*Rm) 



J l6 (z,i,m,n)[k] = 



P l2 *A:*(T,[k)-y[k]) 



[4] 
[5] 
[16] 

[17] 



whereby ASR filter 252 filters transmission signal T3M, noise 
discrimination signal y[k], and audio signal Ri[k] through filter Jt6(z,/,n7,n)[k] to 
provide speech signal U2[k] as an approximation of speech signal Ui[k]. 

25 
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In embodiments of the present invention wherein wireline network 40 is 
omitted, ASR filter 252 establishes a filter J t 7(zJ,m,n)[k] in accordance with the 
following equations [7], [8], [18] and [19]: 

P l3 = c; * W> [7] 
p r3 =A n r *C?*Wj [8] 
#]^ 3 *<*JV,W [18] 

^J.^]- ^ 1 -* 1 -^'^^™ [19] 

p l3 *A;*(T 3 [k]-m) 



whereby ASR filter 252 filters transmission signal T3[k], noise 
discrimination signal y[k],and audio signal Ri[k] through filter Jn(zj,m,n)[k] to 
provide speech signal U2[k] as an approximation of speech signal Ui[k]. 

In embodiments of the present invention wherein wireless network 30 and 
15 wireline network 40 is omitted, ASR filter 252 establishes a filter J (8 (z,m,n)[k] in 
accordance with the following equations [10], [1 1], [20] and [21]: 

P,4=c; [10] 

p r4 = A° r *c; [11] 

20 m = P,A*<*N\k\ [20] 

r , , m Uk]-y{k\-{P„*P r ,*Rm) 

J,g(z,m,n)[k] = [21] 

P i4 *A:*(T } [k)-y[k]) 

whereby ASR filter 252 filters transmission signal T3[k], noise 
discrimination signal y[k], and audio signal Ri[k] through filter Jt8(z,m,n)[k] to 
25 provide speech signal U2[k] as an approximation of speech signal Ui[k]. 
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ASR filtering device 150 (FIG. 3) and ASR filtering device 250 (FIG. 4) 
have been described herein as pre-ASR filtering devices in electrical 
communication with ASR platform 60 (FIG. 1 ). In alternative embodiments of the 

5 present invention, ASR filtering device 150 and ASR filtering device 250 may be 
incorporated into ASR platform 60. 

ASR filtering device 150 (FIG. 3) and ASR filtering device 250 (FIG. 4) 
have also been described herein in the context of an employment within a 
telecommunication system having a transceiver situated within a vehicle. In 

1 0 alternative embodiments of the present invention, ASR filtering device 1 50 and 
ASR filtering device 250 may employed within various other systems used for 
audio communication purposes such as, for example, a video conferencing 
system, and the transceivers of such systems can be situated within the system 
as would occur to those having ordinary skill in the art. 

1 5 While the embodiments of the present invention disclosed herein are 

presently considered to be preferred, various changes and modifications can be 
made without departing from the spirit and scope of the invention. The scope of 
the invention is indicated in the appended claims, and all changes that come 
within the meaning and range of equivalents are intended to be embraced 

20 therein. 
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